Modular refreshable braille display system

ABSTRACT

This specification generally discloses an apparatus, system and method for refreshable braille display. The apparatus can include a first base having a contact surface and a plurality of cavities. The contact surface can be configured to receive fingertips. The plurality of cavities can be recessed from the contact surface. A plurality of pins can be housed within the plurality of cavities and configured to move in the plurality of cavities to selectively extend from the contact surface of the first base. A plurality of solenoids can be configured to at least partially operably connect to the plurality of pins. A controller can be configured to selectively provide a first electric current to the plurality of solenoids to generate first magnetic fields through the plurality of solenoids. The first magnetic fields can be configured to selectively move the plurality of pins to extend from the contact surface of the first base.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to, and the benefit of, ProvisionalApplication No. 63/031,693, filed May 29, 2020 titled “MODULARREFRESHABLE BRAILLE DISPLAY SYSTEM”, the entirety of which isincorporated herein by reference.

TECHNICAL FIELD

This document generally describes apparatuses, systems, and methods forassistive technology, such as braille systems.

BACKGROUND

Braille is a tactile reading and writing system to assist the blind.Braille uses raised dots to represent alphabetical letters and symbols.These dots can be engraved on various materials. Blind people move theirfingers over reading areas in order to read the raised braille dots.Some braille systems include refreshable braille displays, which areelectro-mechanical devices for displaying braille characters. Somerefreshable braille displays can be in wired communication with adevice, such as a computer, and can include braille dots that are raisedand lowered to assist the blind in reading information displayed on thedevice. Some refreshable braille displays can be expensive.

SUMMARY

This document generally describes apparatuses, systems, and methods forassistive technology, such as braille systems. In particular, theapparatus described herein can be a refreshable braille display systemthat is affordable and easy to service for legally blind people, userswho want to learn to read braille or improve their braille literacy,and/or businesses. The technology described herein can provide simplestructures that are portable and can be easily adapted to various typesof devices that users want to interact with. For example, therefreshable braille display system can be implemented in a case for amobile device (e.g., smartphone, tablet, laptop, etc.) to assist blindpeople in reading braille while also interacting with their mobiledevice. In some implementations, the refreshable braille display systemcan be installed in and/or in wireless communication with devices inpublic locations, such as mall kiosks, ATMs, and transit stations. Thesystem described herein can assist blind people in their ability to readinformation that dynamically changes while they are interacting inpublic spaces. In some implementations, the apparatus described hereincan be used to teach users to read and understand braille and improvetheir braille literacy.

The apparatus described herein can include a first base having a barmagnet housed in a housing and a detachable top housing containingvarious coils (e.g., solenoids) wrapped around braille pins and uniquelypowered through a circuit. Use of the bar magnet can reduce a frequencyof servicing one or more components of the system described herein sincethe magnet provides a strong and long-lasting magnetic field. The coilsand braille pins can each be housed in cylinders (e.g., cavities) havingopenings on an upper surface of the top housing. The braille pins housedwithin each of the cylinders can be actuated by sending currents to thecoils so as to extend the pins through the openings. In someimplementations, the braille pins can maintain an attractive force tothe bar magnet so long as no current is passed through the coils. As aresult, the braille pins remain lowered within the cylinder. Whencurrent is passed through the coils, a repulsion force forms between thebraille pins and the bar magnet, thereby pushing the braille pins upthrough the opening. The user can sense the braille pin(s) movingbeneath their fingers and read the braille. In some implementations, thecurrent can be modulated to restrict the pins from extendingindefinitely through the opening, which reduces the potential that oneor more components of the system malfunction and require servicing ormaintenance. Because current is only used to extend pins through theopenings and not to also maintain pins in a lowered position, the systemuses less power/energy and a power source that supplies currents to oneor more components of the system requires less frequent servicing and/orreplacement.

The first base can also include one or more connectors to facilitatecoupling the first base with additional housings, such as a second base.This modular design makes the servicing and/or maintenance of systemcomponents more efficient and easier. The second base can house acontroller, power source, and battery. These components can be in wiredcommunication with one or more components of the first base, such as thecoils. The controller can be configured to determine when current issent to one or more coils to uniquely actuate the associated braillepins. The controller can adjust the timing of current that is sent toeach coil so that the braille pins can be selectively actuated atoptimal times and/or speeds for users. A user can adjust a speed atwhich the braille pins are extend, thereby permitting the user to readthe braille characters at a pace comfortable and suitable for them.Additionally, the user can adjust how braille characters are displayed(e.g., at different time intervals, all at once, repeated characters,etc.). Having the ability to customize the refreshable braille displaysystem described herein can benefit the user in improving their brailleliteracy, learning braille, and/or reading braille in their normalday-to-day life.

In some implementations, the system described herein can be attached toa smartphone or other mobile device. Using BLUETOOTH or other wirelesscommunication, information that is displayed at the mobile device can becommunicated to the controller and converted into braille characters.Alternatively, a wired communication can be used to permit the system tocommunicate with the mobile device. The controller can determine whetherto transmit currents to one or more coils in order to raise the braillepins associated with the converted braille characters. When the systemis part of a case that encloses the mobile device (e.g., a smartphonecase), the user can easily read the braille characters using one hand.The user can hold the device as one normally would and maintain theirfingers in a static position alongside a side of the case. The readingarea may be on the side of the case, so the user does not need to movetheir fingers in order to read braille characters as they are displayed.In some implementations, the braille characters can be displayed one ata time in the reading area while the user maintains their fingers in astatic position over/on the reading area. In other implementations, thebraille characters can be displayed at the same time in the reading areawhile the user maintains their fingers in a static position over/on thereading area. Additionally, as the user holds the device with the handthat is also reading the braille characters, the user can use theirother hand to interact with the mobile device. The user can alsointeract with voice-over technology to control the mobile device whilealso reading the associated braille. This seamless integration makes itfaster and easier for the user to use their mobile device and readbraille at the same time instead of having to do one task at a time.

One or more embodiments described herein can include an apparatus forrefreshable braille display. The apparatus can include a first baseincluding a contact surface and a plurality of cavities, the contactsurface configured to receive fingertips, the plurality of cavitiesbeing recessed from the contact surface, a plurality of pins housedwithin the plurality of cavities and configured to move in the pluralityof cavities to selectively extend from the contact surface of the firstbase, a plurality of solenoids configured to at least partially operablyconnect to the plurality of pins, and a controller configured toselectively provide a first electric current to the plurality ofsolenoids to generate first magnetic fields through the plurality ofsolenoids. The first magnetic fields can selectively move the pluralityof pins to extend from the contact surface of the first base.

The embodiments described herein can optionally include one or more ofthe following features. For example, the apparatus can also include amagnet disposed in the first base. The magnet can generate an attractiveforce relative to the plurality of pins such that the plurality of pinsare biased into the cavities. The first magnetic fields can createrepulsion forces between the plurality of pins and the magnet, therepulsion forces can cause the plurality of pins to extend from thecontact surface of the first base.

As another example, the controller can selectively provide a secondelectric current to the plurality of solenoids to generate secondmagnetic fields through the plurality of solenoids, the second magneticfields can selectively move the plurality of pins into the cavities.Moreover, one or more of the cavities can be removable from the firstbase. The plurality of solenoids can include coils wrapped around thepins. The plurality of coils can be made of a material including iron.

As yet another example, the apparatus can also include a second baseconfigured to house the controller and attach to the first base, and oneor more connectors extending from the first base and configured toengage with the second base to attach the first base to the second base.The one or more connectors can include conductive wires configured toexternally connect the controller to the plurality of solenoids. The oneor more connectors can also include conductive wires configured toelectrically connect the controller to the plurality of solenoids. Theconductive wires of the one or more connectors can be made of a materialincluding copper.

Moreover, the contact surface of the first base can include a pluralityof contact units, each contact unit including one or more of theplurality of cavities and configured to permit for a fingertip tocontact. The contact surface of the first base can permit for multiplefingertips to simultaneously contact the plurality of contact units,respectively. Each of the plurality of contact units of the first basecan include at least six cavities.

The first base can attach to a device having a display and the firstbase can communicate with the device, the device being at least one of acomputer, a smartphone, or a kiosk. In some implementations, the firstbase can be integrated into a wearable device to be worn around a wristof a user. In yet some implementations, the first base can be integratedinto right and left sides of a smartphone case and the smartphone casecan include adjustable side mounts that extend out from the right andleft sides of the smartphone case, the adjustable side mounts configuredto expand to a width of a smartphone and to retain the smartphone in thesmartphone case. Sometimes, the first base can communicate with adevice, the device being at least one of a computer, a smartphone, or akiosk.

In some implementations, the controller can further be configured toreceive text data from a computing device, convert the text data intobraille character data, based on the braille character data, identify asubset of the plurality of pins or a subset of the plurality ofsolenoids that receives the subset of the plurality of pins, wherein thesubset of the plurality of pins represents one or more braillecharacters corresponding to the text data, and transmit the firstelectric current to the subset of the plurality of solenoids such thatthe subset of the plurality of pins moves to extend from the contactsurface of the first base.

Moreover, the contact surface of the first base can permit for multiplefingertips to simultaneously contact the plurality of contact units,respectively. The plurality of contact units can include a first contactunit and a second contact unit. The controller can also receive firsttext data from a computing device, convert the first text data intofirst braille character data, based on the first braille character data,identify a first subset of the plurality of pins in the first contactunit, or a first subset of the plurality of solenoids that receives thefirst subset of the plurality of pins in the first contact unit, whereinthe first subset of the plurality pins represents a first braillecharacter corresponding to the first text data, and transmit the firstelectric current to the first subset of the plurality of solenoids suchthat, at a first time, the first subset of the plurality of pins movesto extend from the first contact unit of the first base.

In some implementations, the controller can also, based on the firstbraille character data, identify a second subset of the plurality ofpins in the second contact unit, or a second subset of the plurality ofsolenoids that receives the second subset of the plurality of pins inthe second contact unit, wherein the second subset of the plurality pinsrepresents the first braille character corresponding to the first textdata, and transmit the first electric current to the second subset ofthe plurality of solenoids such that, at a second time later than thefirst time, the second subset of the plurality of pins moves to extendfrom the first contact unit of the first base, wherein the second subsetof the plurality of pins in the second contact unit is positionedidentically to the first subset of the plurality of pins in the firstcontact unit. As another example, the first subset of the plurality ofpins in the first contact unit is positioned identically to the secondsubset of the plurality of pins in the second contact unit.

The controller can also receive second text data from the computingdevice, convert the second text data into second braille character data,based on the second braille character data, identify a third subset ofthe plurality of pins in the first contact unit, or a third subset ofthe plurality of solenoids that receives the third subset of theplurality of pins in the first contact unit, wherein the third subset ofthe plurality pins represents a second braille character correspondingto the second text data, and transmit the first electric current to thethird subset of the plurality of solenoids such that, at a third time,the third subset of the plurality of pins moves to extend from the firstcontact unit of the first base. In some implementations, the third timecan be (i) identical to the second time, (ii) later than the secondtime, or (iii) earlier than the second time and later than the firsttime. The third time can also be later than the second time. The thirdtime can also be earlier than the second time and later than the firsttime.

In some implementations, the controller can also receive second textdata from the computing device, convert the second text data into secondbraille character data, based on the second braille character data,identify a fourth subset of the plurality of pins in the second contactunit, or a fourth subset of the plurality of solenoids that receives thefourth subset of the plurality of pins in the first contact unit,wherein the fourth subset of the plurality pins represents a secondbraille character corresponding to the second text data, and transmitthe first electric current to the fourth subset of the plurality ofsolenoids such that, at the first time, the fourth subset of theplurality of pins moves to extend from the second contact unit of thefirst base.

One or more embodiments described herein can also include an apparatusfor refreshable braille display. The apparatus can include a first baseincluding a contact surface and a plurality of cavities, the contactsurface configured to receive fingertips, the plurality of cavitiesbeing recessed from the contact surface, a plurality of contact unitsattached to the contact surface and arranged side by side, wherein eachcontact unit includes at least six of the plurality of cavities, andwherein each of the plurality of contact units are configured to beremovable from the contact surface of the first base, a plurality ofpins housed within the plurality of cavities and configured to move inthe plurality of cavities to selectively extend from the contact surfaceof the first base, a plurality of solenoids configured to at leastpartially operably connect to the plurality of pins, and a controllerconfigured to selectively provide a first electric current to theplurality of solenoids to generate first magnetic fields through theplurality of solenoids, wherein the first magnetic fields are configuredto selectively move the plurality of pins to extend from the contactsurface of the first base.

The embodiments described herein can include one or more of thefollowing features. For example, the plurality of contact units caninclude a first contact unit and a second contact unit. The controllercan be configured to receive first text data from a computing device,convert the first text data into first braille character data, based onthe first braille character data, identify a first subset of theplurality of pins in the first contact unit, or a first subset of theplurality of solenoids that receives the first subset of the pluralityof pins in the first contact unit, wherein the first subset of theplurality pins represents a first braille character corresponding to thefirst text data, and transmit the first electric current to the firstsubset of the plurality of solenoids such that, at a first time, thefirst subset of the plurality of pins moves to extend from the firstcontact unit of the first base.

In some implementations, the controller can based on the first braillecharacter data, identify a second subset of the plurality of pins in thesecond contact unit, or a second subset of the plurality of solenoidsthat receives the second subset of the plurality of pins in the secondcontact unit, wherein the second subset of the plurality pins representsthe first braille character corresponding to the first text data, andtransmit the first electric current to the second subset of theplurality of solenoids such that, at a second time later than the firsttime, the second subset of the plurality of pins moves to extend fromthe first contact unit of the first base. The first subset of theplurality of pins in the first contact unit can be positionedidentically to the second subset of the plurality of pins in the secondcontact unit.

In yet some implementations, the controller can receive second text datafrom the computing device, convert the second text data into secondbraille character data, based on the second braille character data,identify a third subset of the plurality of pins in the first contactunit, or a third subset of the plurality of solenoids that receives thethird subset of the plurality of pins in the first contact unit, whereinthe third subset of the plurality pins represents a second braillecharacter corresponding to the second text data, and transmit the firstelectric current to the third subset of the plurality of solenoids suchthat, at a third time, the third subset of the plurality of pins movesto extend from the first contact unit of the first base.

Moreover, the third time can be identical to the second time. The thirdtime can be later than the second time. The third time can be earlierthan the second time and later than the first time. In yet someimplementations, the controller can receive second text data from thecomputing device, convert the second text data into second braillecharacter data, based on the second braille character data, identify afourth subset of the plurality of pins in the second contact unit, or afourth subset of the plurality of solenoids that receives the fourthsubset of the plurality of pins in the first contact unit, wherein thefourth subset of the plurality pins represents a second braillecharacter corresponding to the second text data, and transmit the firstelectric current to the fourth subset of the plurality of solenoids suchthat, at the first time, the fourth subset of the plurality of pinsmoves to extend from the second contact unit of the first base.

One or more advantages can be apparent from the disclosure herein. Forexample, the refreshable braille display system described herein can bemore affordable because the coils can be made from solenoids. Thesolenoids may not use piezo-electric materials, such as ceramics, whichmeans the solenoids can be less expensive to implement, service, and/ormaintain. Solenoid actuators can also operate efficiently with smallcurrent. Solenoid actuators can be scaled down to small structures andcan be less expensive to custom manufacture. For the purpose of creatinga portable refreshable braille display, as described herein, solenoidscan provide more energy, space, and a cost-effective option. Thesolenoids can be made from ferromagnetic materials like iron. An ironcore can be preferred due to its ease to obtain and manufacture lowercost of manufacturing. Additionally, the iron core can be advantageousbecause of its high magnetic permeability, which permits the solenoid tohave a stronger reaction to a bar magnet and the solenoid's generatedmagnetic field. Moreover, covering the solenoids with copper coils cancause the iron core to act as an electromagnet. The solenoids can bepushed by the bar magnet when current is passed through and pulled whencurrent is absent. This configuration can help simulate braille pinmovement. Applying current to the solenoids only when the braille pinshould be raised can be advantageous to reduce an amount ofpower/voltage that is required to operate the system described herein.This can reduce frequency of servicing/replacing components such as thebattery or other power source.

As another example, the apparatus described herein can be easilyadaptable to cases for different types of mobile devices, includingsmartphones, tablets, laptops, and/or kiosks in public locations, suchas transit stations, malls, grocery stores, and banks. For example, thedisclosed apparatus and technology can be applied to smartphone cases.One or more smartphone cases can be made to fit particular types ofsmartphones. One or more smartphone cases can also be adjustable toaccommodate for a variety of differently sized smartphones. As anotherexample, the disclosed apparatus and technology can be applied towearable devices, such as bracelets and smart watches. Thus, a user canread information in Braille on the wearable device by placing theirfingertips on top of braille reading area on the wearable device that isworn around their wrist. Using the wearable device, the user can readinformation that is processed or presented at the user's mobile deviceas well as check time and biometric measurements of the user (e.g.,heartrate, respiration rate, etc.). The disclosed apparatus andtechnology can also be applied to a computer mouse, such that a user cannavigate their computer and read information in braille as it ispresented at a display of the computer. This ease of adaptability canimprove the ability of legally blind users to interact with theirsurroundings and continue normal day-to-day activities. Additionally,the ease of adaptability can make it easier for users to learn how toread braille and/or to improve their braille literacy. Accordingly, theapparatus described herein can be used as a versatile teaching tool.

As another example, the apparatus can have a small form factor. Someimplementations of the apparatus described herein can be carried aroundby users such that the users can attach it to any compatible device theusers intend to use. For example, merely installing software on thecompatible device and establishing a communication (e.g., wired and/orwireless) between the apparatus and the compatible device can providefor ease of interaction for the user.

Moreover, the apparatus can include easily replaceable and detachablemodular components. The first and second bases can be easily detachablefrom each other such that one or more components can be individuallyserviced and/or replaced. The bar magnet can be more efficiently removedfrom its housing and replaced should servicing be required. The batteryin the second base can easily be replaced by detaching the first andsecond bases. Additionally, any one of the coils and/or braille pins canbe replaced or serviced. In some implementations, as with the wearabledevice mentioned above, the apparatus can be charged using wirelesscharging. As a result, a battery, for example, may not need to bereplaced.

As another example, the apparatus can include a minimum number ofbraille pins needed to display a braille character. Replacement andmaintenance of such pins can therefore be easier and faster. The usercan replace a singular pin, coil, and/or cylinder housing the coil andpin rather than having to replace an entire unit of braille pins or allthe pins in the reading area, which can be more costly and timely. Thereading area of the small form factor apparatus (e.g., the apparatusincorporated in a smartphone case) can typically be smaller than theaverage reading area, so maintaining fewer braille pins in the readingarea can be less expensive, easier and more efficient to service, andalso easier and faster for the user to read. The smaller form factoralso makes it easier to apply the apparatus to different devices, asdescribed above. More so, the smaller form factor can make it easier forthe user to read because they may not have to move their fingertips overand/or across a reading area. Instead, the user may keep theirfingertips in one position (e.g., on a side of a smartphone case in anormal manner in which the user holds their smartphone). In thatposition, the user can hold their smartphone, for example, as well asread information in braille as it is presented on a display of thesmartphone.

As yet another example, the apparatus described herein can provide foreasier and faster reading of braille. The user merely positions at leastone finger on top of the reading area. The user may not have to movetheir fingers to read the braille characters. Braille pins can beactuated in such a way to simulate the reading process. The pins cancontinuously move beneath the user's static fingers in order toreplicate each braille character associated with a string of text. Thepins can also be actuated so as to repeat braille characters beforedisplaying other braille characters, which can be advantageous to assistthe user in learning how to read braille. The user can also customizehow braille characters are displayed (e.g., time intervals between eachcharacter, speed at which characters are displayed, etc.) based on theuser's braille literacy and/or desire to learn how to read braille. Thisconfiguration is also advantageous to permit the user ease of readingbraille while interacting with their mobile device at the same time.

Moreover, the apparatus described herein can be made of aluminum orsimilar material. This type of material can be advantageous to make theapparatus durable. Increased durability can reduce a need formaintenance and/or repairs to components of the disclosed apparatus.Additionally, the apparatus can include silicone gel or similar plasticmaterial features to improve comfortability for the user. For example, asmartphone case having the disclosed apparatus can include silicone gelmaterial around a braille reading area. This material can be textured(e.g., ribbed). This material can provide for better grip for the user.This material can also improve an aesthetic appearance of the disclosedapparatus when used with devices such as smartphone and wearabledevices.

The details of one or more embodiments are set forth in the accompanyingdrawings and the description below. Other features and advantages willbe apparent from the description and drawings, and from the claims.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 depicts an exemplary refreshable braille display system describedherein.

FIGS. 2A-C depict exemplary views of the refreshable braille displaysystem configured to mobile devices.

FIG. 3 depicts an exemplary unit of braille pins of the refreshablebraille display system described herein.

FIGS. 4A-F depict an exemplary refreshable braille display systemconfiguration.

FIG. 5 depicts an exemplary schematic of the refreshable braille displaysystem described herein.

FIG. 6 depicts an exemplary schematic of a braille pin of therefreshable braille display system described herein.

FIG. 7 depicts an exemplary refreshable braille display system.

FIG. 8 depicts an exemplary use of the refreshable braille displaysystem.

FIG. 9 depicts an exemplary actuation of the refreshable braille displaysystem.

FIG. 10 depicts an exemplary actuation of the refreshable brailledisplay system.

FIG. 11 is a flowchart to use the refreshable braille display system.

FIG. 12 is a flowchart to assemble the refreshable braille displaysystem.

FIG. 13 depicts an exemplary refreshable braille display mouse.

FIG. 14 depicts an exemplary refreshable braille display smartphonemount case.

FIG. 15 depicts an exemplary refreshable braille display wearabledevice.

FIG. 16 is a block diagram of computing devices that may be used toimplement the apparatuses, systems and methods described herein.

DETAILED DESCRIPTION

This document generally describes apparatuses and methods for assistivetechnology, namely a modular refreshable braille display system.

FIG. 1 depicts an exemplary refreshable braille display apparatus 100described herein. System 140 can include the apparatus 100, a userdevice 102, and a network 106. The refreshable braille display apparatus100 can include a communication interface 108, a power source 112, amicrocontroller 114, a magnet 120, and one or more units 122A-N (e.g.,contact units). The apparatus 100 can be in communication with the userdevice 102 (e.g., computing device). The communication can be wireless,such as via BLUETOOTH technology. In other implementations, thecommunication can be through WIFI or a cellular network. The apparatus100 and the user device 102 can communicate via the network 106.

The user device 102 can include a mobile application 104. The mobileapplication 104 can connect the user device 102 to the apparatus 100 viaa BLUETOOTH connection. Text data displayed at the user device 102 canbe transmitted to the microcontroller 114 so that the text data can beconverted to braille character data, and used by the apparatus 100 inorder to actuate one or more braille pins (e.g., refer to FIG. 11 ). Themobile application 104 can be configured to read existing APIsassociated with different systems or applications on the user device102, such as a device operating system, a banking application, amessaging application, a web browser, etc., so that it can communicatetext data associated with those systems or applications to themicrocontroller 114. As a result, the apparatus 100 can translate intobraille character data text data that originate from various sources(e.g., applications, systems, etc.) in the user device 102 and isdisplayed at the user device 102. In some implementations, the user canalso use voice-over technologies to navigate applications and systems onthe user device 102. Text data displayed as a result of using thevoice-over technologies can be transmitted to the microcontroller 114and converted into readable braille character data. This is advantageousbecause the user can seamlessly interact with various applications orsystems on the user device 102 while also reading braille character datathat is displayed by the apparatus 100.

The mobile application 104 can be used by a user at the user device 102to customize one or more settings of the apparatus 100. In someimplementations, the user can use the mobile application 104 to pairand/or connect the user device 102 with the refreshable braille displayapparatus 100. For example, the user can use the mobile application 104to adjust a speed at which braille pins are actuated at the apparatus100. As a result, the user can adjust how quickly braille character datais displayed and how quickly the user reads the braille character data.Adjusting various settings of the apparatus 100 by using the mobileapplication 104 can help the user improve their braille literacy and/orlearn how to read braille.

The user can also use the mobile application 104 to test and/ortroubleshoot one or more components of the apparatus 100. For example,in some implementations, the mobile application 104 can generate a setof test text data and transmit it to the apparatus 100. The apparatus100 can then convert the test text data into braille character data andprovide currents to one or more units of braille pins to actuate thebraille pins in accordance with the braille character data. The user canthen read the raised braille pins to determine whether the pinsaccurately display the braille character data and the corresponding testtext data. In yet other implementations, the user can receivenotifications at the mobile application 104 when the apparatus 100 isdisconnected from the user device 102 and/or when one or more componentsof the apparatus 100 require servicing and/or maintenance. For example,if the power source 112 (e.g., a battery) needs to be replaced, the usercan receive a notification at the mobile application 104. The user atthe mobile application 104 can also receive a notification when one ormore braille pins and/or solenoids need to be replaced.

Still referring to the refreshable braille display apparatus 100, thecommunication interface 108 is configured to transmit information, suchas text data displayed at the user device 102, to the apparatus 100. Thecommunication interface 108 can include a wireless communication module110 and a wired communication module 111. The wireless communicationmodule 110 can be configured to facilitate wirelesscommunication/connectivity with the user device 102. Example of suchwireless communication can include BLUETOOTH communication.Alternatively, the wired communication module 111 can permit wiredconnection and communication between the apparatus 100 and the userdevice 102.

The power source 112 is configured to supply electric power to thecomponents of the apparatus 100. Examples of the power source 112 caninclude a battery. In some implementations, the apparatus 100 can be inwired communication with an external power source, such as a battery ofthe user device 102 or electrical outlets of various types (e.g., ACmains, USB ports, etc.).

The microcontroller 114 can include a conversion module 116 and acurrent actuator 118. The conversion module 116 can be configured toreceive text data from the user device 102 and convert the text datainto braille character data (e.g., refer to FIG. 11 ). The conversionmodule 116 can be in communication with a dictionary database 136 inorder to determine accurate conversions of the text data into thebraille character data. The current actuator 118 can be configured todetermine whether a current should be transmitted to one or more units122A-N and/or braille pins in the units (as further described herein).This determination can be based, at least in part, on the braillecharacter data. The braille character data can include information aboutwhich braille pins needs to be raised for a user to read braillecharacters that are identified by the braille character data associatedwith the text data. In some implementations, the current actuator 118can also determine an amount of current that needs to be supplied to oneor more of the units and/or the braille pins in the units.

The apparatus 100 further includes at least one magnet 120 (e.g., barmagnet). One or more braille pins can be attracted to the magnet 120 byan attractive force, thereby causing the one or more braille pins toremain lowered, as described further herein. One bar magnet 120 can beadvantageous to reduce frequency and cost of servicing or replacing themagnet 120. In some implementations, the apparatus 100 can include morethan one magnet. For example, each of the units 122A-N can include a barmagnet in order to improve versatility. Having more than one bar magnetcan be advantageous where the apparatus 100 attaches to a large userdevice, such as a laptop or kiosk that has a larger reading area withmore units of braille pins.

Still referring to the apparatus 100, each unit 122 (e.g., 122A, 122B .. . 122N) can have one or more braille pins and one or more solenoids.For example, the unit 122A can include one or more braille pins 124A-Nand one or more solenoids 126A-N. The unit 122B can include one or morebraille pins 128A-N and one or more solenoids 130A-N. The unit 122N caninclude one or more braille pins 132A-N and one or more solenoids134A-N. In some implementations, each of the units 122A-N can includesix braille pins 124A-N, 128A-N, and 132A-N, respectively (e.g., referto FIG. 3 ). Six braille pins can be a minimum number of pins to displaya braille character. In other implementations, fewer or more than sixbraille pins can be used in each unit 122. Fewer pins can allow lessfrequent and less costly servicing. Fewer pins also makes it easier toservice and/or replace individual pins.

In other implementations, one or more of the units 122A-N can includeeight braille pins 124A-N, 128A-N, and 132A-N, respectively. In someimplementations, the refreshable braille display apparatus 100 can bemanufactured and configured with a predetermined number of units 122A-N,each having six braille pins. For example, the apparatus can includefour units 122A-N, each having six braille pins, totaling 24 pins. Inother implementations, a user can customize their apparatus 100 toinclude as many units 122A-N and/or how many braille pins 124A-N,128A-N, and 132A-N per unit. This customization can be limited by a sizeof a reading area on the refreshable braille display apparatus 100. Forexample, an apparatus 100 configured as a smartphone can have a smallerreading area than an apparatus 100 configured as a case for a laptop ortablet having a larger reading area. In some implementations, the usermay prefer having more than six braille pins per unit (e.g., eightbraille pins) in order to experience more ease in reading braille. Thisconfiguration can be beneficial for users who are learning to readbraille and/or improving their braille literacy.

Each of the braille pins 124A-N, 128A-N, and 132A-N can be at leastpartially wrapped in the solenoids 126A-N, 130A-N, and 134A-N,respectively (e.g., refer to FIGS. 5-6 ). The solenoids 126A-N, 130A-N,and 134A-N can be coils and can provide current(s) to one of morebraille pins 124A-N, 128A-N, and 132A-N, respectively, in order toextend one or more of the pins such that the user can read theassociated braille character data (e.g., refer to FIGS. 5, 11 ).

FIGS. 2A-C depict views of example refreshable braille displayapparatuses configured to various devices. FIG. 2A depicts an examplerefreshable braille display apparatus as a case 200 configured to attachto an ANDROID™ mobile device. FIG. 2B depicts another examplerefreshable braille display apparatus as the case 200 configured toattach to an APPLE mobile device (e.g., iPhone). FIG. 2C depicts yetanother example refreshable braille display apparatus as casesconfigured to attach to both APPLE mobile devices 210 and ANDROID mobiledevices 220.

Referring to FIGS. 2A-C, the case 200 includes a detachable upperportion 200A and a bottom portion 200B. The upper portion 200A and thebottom portion 200B can be attached to each other by one or moreconnectors (e.g., fasteners, pins, snaps). Alternatively, the upperportion 200A and the bottom portion 200B can be made as a single unit. Auser can snap the case 200 around the mobile device (e.g., smartphone,cellphone) to secure it in place. The bottom portion 200B of the case200 can include a reading area 202 having a plurality of braille pins204A-N (e.g., refer to FIGS. 3-5, 7-10 ). The braille pins 204A-N can beincluded in units (e.g., contact units), as described throughout thisdisclosure. Each unit can be controlled separately by a controller(e.g., the microcontroller 114 in FIG. 1 ), wherein each unit receivesone or more currents at different times to display one or more braillecharacter data. In implementations where each braille character isdisplayed a number of times equivalent to a number of units, the usercan read each braille character without having to move their finger(s)over the reading area 202 (e.g., refer to FIGS. 8-10 ).

As described herein, the braille pins 204A-N can be extended from thebottom portion 200B, such that they are readable by the user. The usercan statically position one or more fingers over the reading area 202.As one of more of the pins 204A-N are actuated to extend from the bottomportion 200B of the case 200, the user does not have to move theirfingers along the reading area 202. This is because one or more currentscan be sent to the units (e.g., contact units) of pins 204A-N such thateach braille character is delivered one at a time and repeated acrossthe units of pins 204A-N (e.g., refer to FIGS. 9, 11 ). Regardless ofwhere the user positions their finger(s), the user can read each braillecharacter that is displayed and/or confirm braille character data thatis read by the user. This configuration is advantageous to help the userlearn braille and improve their braille literacy. In otherimplementations, the user can statically position their fingers overeach unit of braille pins 204A-N and each unit can receive a current toactuate the braille pins 204A-N in that unit to correspond to differentbraille character data (e.g., refer to FIG. 10 ). The user does not haveto move their fingers along the reading area 202 in order to readmultiple braille characters at the same time. This is advantageous forusers that are familiar and/or comfortable with reading braille (e.g.,legally blind users).

Still referring to FIGS. 2A-C, in some implementations, the case 200 caninclude more than one reading area 202. For example, reading areas canbe located on any sides of the bottom portion 200B and/or the upperportion 200A of the case 200. In other implementations, the reading area202 can be on a back side of the case 200. Positioning the reading area202 on the back of the case 200 can be advantageous where the case 200is configured to attach to larger devices, such as tablets and laptops.

The configurations depicted in FIGS. 2A-C are advantageous for use byany type of user, regardless of whether they are legally blind, wantingto learn how to read braille, right-handed, or left-handed. In someimplementations, the units of pins 204A-N can be manufactured/installedon a right side or a left side of the bottom portion 200B of the case200. In other implementations where the pins 204A-N can only beinstalled on one side of the bottom portion 200B of the case 200 (e.g.,on the right side), a user can still read braille characters because theuser is not required to move their fingers over the reading area 202. Ifthe user holds the mobile device in a left hand and the pins 204A-N areinstalled on the right side of the bottom portion 200B of the case 200,then at least one finger (e.g., index, middle, ring, and/or pinkiefinger) is statically positioned over a portion of the reading area 202(e.g., one or more units of the pins 204A-N) to read each braillecharacter as it is displayed. Likewise, if the user holds the mobiledevice in a right hand and the pins 204A-N are installed on a right sideof the bottom portion 200B of the case 200, then the user's thumb can bestatically positioned over any portion (e.g., at least one unit of pins204A-N) of the reading area 202 such that the user can read each braillecharacter as it is displayed in each unit of the pins 204A-N.

In some implementations, the case 200 can be manufactured to attach to alarger computing device, such as a tablet and/or a computer (e.g.,laptop). In the case of the tablet, the reading area 202 can be locatedon a back side of the case 200. As the user holds the tablet with one ortwo hands, the user's fingers can be positioned over the reading area202 in order to reach each braille character as it is displayed. Thecase 200 of the tablet can include multiple reading areas 202, forexample, for each hand that holds the tablet. The braille character datacan be displayed at a same time in both reading areas and/or atdifferent times. Some braille character data can be displayed at onereading area while other braille character data is displayed at a secondreading area. The user can modify how braille character data isdisplayed at the reading area(s) 202 by interacting with the mobileapplication 104, as described in FIG. 1 . In the case of a laptop, thereading area 202 can be located on any portion of the laptop, such as aregion below a keyboard, alongside a touchpad, and/or along a perimeterof a display screen. In these various applications of the case 200 todifferent computing devices, the refreshable braille display apparatusdescribed herein functions in the same or similar manners, and providesthe same or similar benefits described herein.

FIG. 3 depicts an exemplary unit 300 (e.g., contact unit) of braillepins. The unit 300 includes one or more braille pins 204 (e.g., 204A-F).As depicted, the unit 300 includes six pins 204A-F. Six pins can be abeneficial minimum number of pins required to display any braillecharacter. In addition, using the minimum number of pins can reducepotential servicing of individual pins, units, or other components ofthe refreshable braille display apparatus. Reducing frequency ofservicing can reduce associated servicing costs. Moreover, having theminimum number of pins in a unit can make it easier and faster toidentify any particular pin that requires servicing.

Alternatively, the unit 300 can include more or less than six pins. Insome implementations, eight pins can be a preferred number of pins perunit. Eight pins can be beneficial in configurations where a readingarea (e.g., refer to the reading area 202 in FIGS. 2A-C) is larger(e.g., when the refreshable braille display apparatus is configured toattach to a larger computing device, such as a laptop or tablet). Asdepicted in FIGS. 2A-C, the reading area 202 comprises of thirteen unitsof six pins each. Each unit 300 of the thirteen units can be controlledseparately (e.g., refer to FIGS. 9-11 ) such that braille character datais displayed at different times at each unit 300. In otherimplementations, the reading area 202 can include more or less than 13units.

The unit 300 includes one or more cavities 302 (e.g., 302A-F) (e.g.,containers, cylinders) (e.g., refer to FIGS. 4-6 ). As depicted in FIG.3 , there are six cavities 302A-F, each of which house the six braillepins 204A-F. In a configuration in which the unit 300 has eight pins204, the unit 300 can include eight cavities 302. As depicted in FIG. 3, each of the cavities 302A-F has an opening in which a braille pin canbe selectively extended through, such that the pin can display a braillecharacter that the user reads. In some implementations, one or more ofthe pins 204A-F can be removable from the cavities 302A-F. This can bebeneficial to provide for easy and efficient servicing of the pins204A-F and/or solenoids wrapped at least partially around the pins204A-F. For example, a user can replace a single pin rather than replacean entire unit of braille pins where the single pin requiresmaintenance. This is both less expensive and faster servicing. In someimplementations, the unit 300 can include a bar magnet housed oppositethe cavities 302A-F, which can improve versatility.

The unit 300 can be attached to a contact surface of a first base, suchas the bottom portion 200B of the case 200 depicted and described inFIGS. 2A-C. The contact surface can be configured to permit multiplefingertips to simultaneously contact the unit 300 or a plurality ofunits. In some implementations, the contact surface can receive one ortwo units. In other implementations, the contact surface can receivemore than two units. In some implementations, the unit 300 can beremovable from the contact surface and replaced with another unit. Thisis advantageous for servicing and maintenance of one or more componentsof the unit 300. Regardless of how many units are attached to thecontact surface, each set of pins 204A-F within each unit can bepositioned identically. Additionally, the units can be positionedalongside each other (e.g., side-by-side) on the contact surface.

FIGS. 4A-F depict an exemplary refreshable braille display apparatusconfiguration. In FIG. 4A, a case 400 can be attached to a mobiledevice, such as a smartphone (e.g., refer to the user device 102 in FIG.1 , FIGS. 2A-C). Depicted is a backside of the case 400. Embedded withinthe backside of the case 400 is a communication interface 402, amicrocontroller 404, a battery 406, and a power strip 420. Thecommunication interface 402 can be configured and operate similarly tothe communication interface 108 in FIG. 1 . The microcontroller 404 canbe configured and operate similarly to the microcontroller 114 in FIG. 1. The battery 406 can be configured and operate similarly to the powersource 112 depicted in FIG. 1 . The battery 406 can supply power to themicrocontroller 404. In some implementations, the battery 406 can alsosupply power to the communication interface 402. As depicted in FIG. 4A,the communication interface 402 can be powered by energy transmittedfrom the battery 406 to the microcontroller 404. The power strip 420 canbe configured to disperse electric currents to one or more braillepins/units of pins in accordance with output from the microcontroller404.

In some implementations, the battery 406 can be 3.7v 5000 mah. Thebattery 406 can be charged by a charging controller 410. The chargingcontroller 410 can receive a Micro USB, USB-C, and/or Lightning cable,depending on a type of mobile device that the case 400 is attached to.In some implementations, the battery 406 can be charged by connectingit, via a charging cable previously described, to the mobile device. Inother implementations, the battery 406 can be charged by connecting itto an outlet or other charging port. The battery 406 can be easily andmore efficiently replaced with a new battery. In yet otherimplementations, the battery 406 can be wirelessly charged.

Still referring to FIG. 4A, one or more units 408A-N of braille pins arepositioned along a side of the case 400 and in wired communication withone or more components of the refreshable braille display apparatus 100.The units 408A-N can be configured and operate similarly to the units122A-N depicted in FIG. 1 . As depicted in FIG. 4A, the units 408A-N arein wired communication with the microcontroller 404. In otherimplementations, the units 408A-N can also be in wired communicationwith the battery 406.

FIG. 4B depicts the unit 408A. The unit 408A includes six cavities418A-F configured to house braille pins (e.g., refer to FIGS. 3, 5-6 ).Each of the cavities 418A-F are in wired communication with themicrocontroller by wires 416A-F (e.g., refer to the solenoids depictedin FIGS. 1, 5-6 ). The microcontroller can send input signals to one ormore of the braille pins housed in each of the cavities 418A-F using thewires 416A-F. In some implementations, the signals coming from themicrocontroller can be a bus with a width of three signals, wherein aseries of wires transmits each signal separately to the unit 408A and/orthe cavities 418A-F. As described further herein, the input signalsgenerate currents that cause one or more of the braille pins toselectively extend through the cavities 418A-F so that a user can readthe braille characters (e.g., refer to FIG. 11 ). The unit 408A can alsobe in wired communication with the battery via an electrical connector414.

Still referring to FIG. 4B, in some implementations, the unit 408Aactuates by receiving a signal (e.g., +5V) from the battery via theelectrical connector 414. The unit 408A can be configured to beconnected to a positive voltage supply from the battery. Themicrocontroller can be configured to ground the unit 408A's receivedsignal for each of the cavities 418A-F, which causes one or more braillepins within the cavities 418A-F to remain lowered. The microcontrollercan also be configured to send a signal (e.g., +5V), via the power strip420 described in reference to FIG. 4A, to the unit 408A to control thecavities 418A-F. The signal from the microcontroller can cause one ormore braille pins within the cavities 418A-F to extend through anopening in the cavities 418A-F (e.g., refer to FIG. 5, 11 ). As aresult, the microcontroller merely sends one signal to the unit 408A inorder to selectively extend one or more braille pins from the cavities418A-F. This configuration is advantageous in order to reduce an amountof power required to operate the refreshable braille display apparatus.This can also be advantageous because one or more components of theapparatus described herein (e.g., the wires 416A-F, the battery 406,etc.) can require less servicing, maintenance, and/or replacement.

FIG. 4C depicts one or more of the components described in FIGS. 4A-B inwired communication with each other. For example, electrical power (inthe form of voltage and/or current) can be provided from the battery 406to the unit 408A or any of the other unit in the apparatus. In otherimplementations, the unit 408A and any of the other units in theapparatus can be in wired communication with only the microcontroller404 and can receive electric currents from the power strip 420previously described in reference to FIG. 4A. Voltage can also beprovided from the battery 406 to the microcontroller 404 in order topower the microcontroller 404. Voltage can also be provided from thebattery 406 to the communication interface 402 such that thecommunication interface 402 can operate and receive wireless signals(e.g., via BLUETOOTH technology) with a mobile device. In otherimplementations, the communication interface 402 can be in wiredcommunication with only the microcontroller 404 and can be powered byvoltage that is provided from the battery 406 to the microcontroller404.

Still referring to FIG. 4C, the communication interface 402 can havetwo-way wired communication with the microcontroller 404. For example,the microcontroller 404 can send a request to the communicationinterface 402 to determine whether text data has been received from themobile device (e.g., refer to FIG. 11 ). The communication interface 402can also transmit text data received from the mobile device to themicrocontroller 404. The text data can be transmitted from thecommunication interface 402 upon request from the microcontroller 404 orautomatically (e.g., once the test data has been received at thecommunication interface 402 without requiring a request from themicrocontroller 404). Additionally, as depicted, the microcontroller 404can be in wired communication with the unit 408A, as well as each of theunits in the apparatus described herein. As described regarding FIGS.4A-B, the microcontroller 404 can communicate with the unit 408A andeach of the units in the apparatus in order to control actuation of oneor more braille pins within each of the units.

FIG. 4D depicts one or more of the components described in FIGS. 4A-C.FIG. 4E depicts one or more components of the refreshable brailledisplay apparatus described in FIGS. 4A-D. In FIG. 4E, a magnet 120(e.g., the bar magnet 120 in FIG. 1 ) is depicted within the case 400(e.g., refer to the case 400 in FIG. 4A). The magnet 120 can bepositioned behind one or more units of braille pins (e.g., refer to theone or more units 408A-N in FIG. 4A). As depicted in FIG. 4E, in someimplementations, one or more wires 422A-N can pass current from a powerstrip 420 to each of the one or more braille pins. In otherimplementations, one or more wires 422A-N can pass current from thepower strip 420 to each of the one or more units of braille pins. FIG.4F depicts one or more components of the refreshable braille displayapparatus described in FIGS. 4A-E without the magnet 120 depicted anddescribed above.

FIG. 5 depicts an exemplary schematic of the refreshable braille displayapparatus 100 described herein. The apparatus 100 includes a first base500. The first base 500 includes a contact surface 510, which can beconfigured to receive fingertips of a user (e.g., refer to FIG. 8 ). Thefirst base 500 also includes a plurality of cavities 512A-N (e.g.,openings) (e.g., refer to the cavities 302A-N in FIG. 3 ). The pluralityof cavities 512A-N can be recessed from the contact surface 510, asdepicted in FIG. 5 . As described herein, one or more of the cavities512A-N can be removable from the base 500. A plurality of pins 514A-N(e.g., refer to the pins 204A-N in FIGS. 2A-C) can be housed within theplurality of cavities 512A-N and configured to move in the plurality ofcavities 512A-N to selectively extend from the contact surface 510 ofthe first base 500.

A plurality of solenoids 516A-N (e.g., refer to FIG. 6 ) can beconfigured to at least partially receive and/or operably connect to theplurality of pins 514A-N. As depicted, the plurality of solenoids 516A-Nare coils that wrap around the plurality of pins 514A-N. In someimplementations, the plurality of solenoids 516A-N can be made of amaterial including iron. In some implementations, a magnet 502 can beconfigured to generate an attractive force relative to the plurality ofpins 514A-N such that the plurality of pins 514A-N are biased into thecavities 512A-N. The apparatus 100 further includes a controller, whichcan be configured to selectively provide an electric current to theplurality of solenoids 516A-N to generate a magnetic field or repulsiveforce through the plurality of solenoids 516A-N. The magneticfield/repulsive force can be configured to selectively move theplurality of pins 514A-N to extend from the contact surface 510 of thefirst base 500 and away from the magnet 502. In yet otherimplementations, the controller can be configured to selectively providea first electric current to the plurality of solenoids 516A-N togenerate first magnetic fields through the plurality of solenoids516A-N. The first magnetic fields can be configured to selectively movethe plurality of pins 514A-N to extend from the contact surface 510 ofthe first base 500. In some implementations, the controller can also beconfigured to selectively provide a second electric current to theplurality of solenoids 516A-N to generate second magnet fields throughthe plurality of solenoids 516A-N. The second magnetic fields can beconfigured to selectively move the plurality of pins 514A-N into thecavities 512A-N.

The plurality of cavities 512A-N as well as the pins 514A-N can bearranged into one or more contact units 508A-N (e.g., refer to FIGS. 3,8-10 ). In some implementations, the contact surface 510 can include theplurality of contact units 508A-N, wherein each contact unit has one ormore of the plurality of cavities 512A-N. Each of the contact units508A-N can be configured to permit for a fingertip to contact such thatthe user can read braille as the pins 514A-N are selectively extendedfrom the contact surface 510 in each of the contact units 508A-N. Thecontact surface 510 can be configured to permit multiple fingertips tosimultaneously contact the plurality of contact units 508A-N,respectively (e.g., refer to FIGS. 9-10 ). The contact surface 510 canbe configured to receive at least one or more contact units 508A-N, suchas a first contact unit and a second contact unit. In someimplementations, each of the plurality of contact units 508A-N of thefirst base 500 can include at least six cavities 512A-N (e.g., refer toFIG. 3 ). A first subset of the plurality of pins 514A-N (e.g., sixpins) in the first contact unit can be positioned identically to asecond subset of the plurality of pins 514A-N (e.g., six pins) in thesecond contact unit. As depicted in FIG. 5 , the contact units 508A-Ncan be arranged side by side, along a length of the first base 500.

Still referring to FIG. 5 , the apparatus 100 includes the magnet 502disposed in a housing 502. The magnet 502 can be a bar magnet. Themagnet 502 can extend an entire length of the first base 500. In someimplementations, the magnet 502 can extend for a shorter length of thefirst base 500. In yet other implementations one or more magnets 502 canbe positioned along a length of the first base 500. The magnet 502 canbe configured to generate an attractive force relative to the pluralityof pins 514A-N. As a result of the attractive force, the plurality ofpins 514A-N can be biased into the cavities 512A-N. The first magnetfields generated by the plurality of solenoids 516A-N can createrepulsion forces between the plurality of pins 514A-N and the magnet502. Such repulsion forces can be configured to cause the plurality ofpins 514A-N to extend from the contract surface 510 of the first base500.

The apparatus 100 can further include a second base 520 that isconfigured to house the controller previously described (e.g., refer toFIGS. 4A-C). The second base 520 can attach to the first base 500 by oneor more connectors 504A-N that extend from the first base 500. Theconnectors 504A-N can be configured to engage with the second base 520to attach the first base 500 to the second base 520. The connectors504A-N can include conductive wires that are configured to electricallyconnect the controller to the plurality of solenoids 516A-N. In someimplementations, the conductive wires of the connectors 504A-N can bemade of a material including copper. In some implementations, the secondbase 520 can optionally house a battery or other power source thatprovides power to one or more components of the apparatus 100 describedherein (e.g., refer to FIGS. 4A-C).

FIG. 6 depicts an exemplary schematic of a braille pin 600 of therefreshable braille display apparatus described herein. As depicted, thebraille pin 600 is recessed at least partially within a cavity 604(e.g., one of the plurality of cavities 512A-N depicted in FIG. 5 ). Thecavity 604 includes an opening 602 on a contact surface 614 (e.g., referto the contact surface 510 in FIG. 5 ). The pin 600 can extend throughthe opening 602 such that a braille dot 606 of the pin 600 is above thecontact surface 614. The user can place their fingertip(s) over thecontact surface 614 and read the raised braille dot 606. A horizontalbar 612 (e.g., flange, stopper) can be positioned beneath the brailledot 606 such that the pin 600 does not fully extend through the opening602. This configuration can be beneficial to ensure the pin 600 remainswithin the cavity 604 and/or does not fall out while the refreshablebraille display apparatus is used by the user. In some implementations,the pin 600 may not include the horizontal bar 612.

Still referring to FIG. 6 , the cavity 604 can include solenoidconnectors 608A-B. The solenoid connectors 608A-B can be configured toreceive electric currents from the controller described herein (e.g.,refer to FIGS. 5, 11 ). The solenoid connectors 608A-N are connected toa solenoid 610 (e.g., refer to the solenoids 516A-N in FIG. 5 ). Uponreceiving electric currents at the solenoid connectors 608A-B, thecurrents can be passed to the solenoid 610 and the solenoid 610 cangenerate corresponding magnet fields. These magnetic fields, asdescribed throughout this disclosure (e.g., refer to FIGS. 5, 11 ), cancreate attractive and/or negative (e.g., repulsion) forces between thepin 600 and a magnet (e.g., refer to the magnet 502 in FIG. 5 ) suchthat the pin 600 biases into the cavity 604 and/or extends through theopening 602, respectively.

As depicted, the solenoid 610 is a coil that wraps at least partiallyaround the pin 600. The coil can be made of a material including iron.The solenoid 610 can also be wrapped in an insulator in order to preventthe solenoid 610 from breaking. The configuration of the solenoid 610 asdepicted in FIG. 6 is advantageous to reduce effort, cost, and time inservicing the solenoid 610 or any other components housed within thecavity 604. For example, if the solenoid 610 malfunctions, a user canremove the solenoid 610 without having to remove other components of theapparatus, such as the magnet. In some implementations, as describedthroughout this disclosure, the user can replace the entire cavity 604with a new cavity having a new solenoid, solenoid connectors, and/orbraille pin. In other implementations, as described, the user canreplace a unit of pins with a new unit of pins in order to increaseefficiency and ease of servicing one or more components therein.

As depicted in FIG. 6 , the pin 600 is biased towards a bottom of thecavity 604, which is closer to the magnet (e.g., refer to FIG. 5 ). Thepin 600 is biased towards the bottom of the cavity 604 by an attractiveforce to the magnet. This configuration is advantageous because the pin600 can remain biased towards the bottom of the cavity 604 so long as anelectric current is not generated or received by the solenoid connectors608A-B. As a result, less power/current can be used to power therefreshable braille display apparatus described herein, which can reduceservicing, maintenance, and related costs. Because current is managed orbeing provided in small amounts to some rather than all cavities, lessvoltage is required to operate the refreshable braille display apparatusdescribed throughout this disclosure. In other implementations, the pin600 can be attracted to the magnet by a current (e.g., a second current)that is received by the solenoid connectors 608A-B and which is used bythe solenoid 610 to generate a magnetic field. The generated magneticfield can create an attractive force between the pin 600 and the magnet,thereby biasing the pin 600 towards the bottom of the cavity 604.

FIG. 7 depicts an exemplary refreshable braille display apparatus 700(e.g., refer to the refreshable braille display apparatus 100 describedthroughout this disclosure). In this example, the apparatus 700 isconfigured to attach to a touchscreen 704 of a kiosk 704. The apparatus700 is attached proximate to the touchscreen 704. In otherimplementations, the apparatus 700 can be attached to any other part ofthe kiosk 702 and/or the touchscreen 704 where there is a connectivitypoint. In some implementations, the apparatus 700 can be carried by auser and the user can connect the apparatus 700 to any compatibledevice, such as the kiosk 702. In other implementations, devices, suchas the kiosk 702 can be manufactured with the apparatus 700. In yetother implementations, the apparatus 700 can be configured to attach toany compatible device, such as the kiosk 702, after the kiosk 702 hasbeen manufactured, having BLUETOOTH communication capability and/or aUSB port.

In the example depicted in FIG. 7 , the apparatus 700 can be configuredto attach to the touchscreen 704 via a USB port in the touchscreen 704.Information (e.g., text data) that is displayed on the touchscreen 704can then be transmitted to the apparatus 700, via the USB communicationand/or BLUETOOTH technology, converted into braille character data, andthen used to actuate one or more braille pins comprising the apparatus700 (e.g., refer to FIG. 10 ). Information can be transmittedwirelessly, via software or a mobile application that establishes aBLUETOOTH and/or WIFI connection between the kiosk 702 and the apparatus700.

As mentioned, the apparatus 700 can be configured to attach to anydevice having a display, such as a computer, laptop, tablet, smartphone,and/or kiosk. The kiosk 702 can be located in a transit station (e.g.,airport, train station, subway, bus terminal, etc.). The kiosk 702 canalso be used in other public locations, such as grocery stores (e.g., todisplay product pricing, etc.), gas stations (e.g., to purchase productsor gas, etc.), and malls (e.g., to display product pricing, navigate,etc.). Incorporating the apparatus 700 into any one of these types ofkiosks 702 can be advantageous to help legally blind people navigate andinteract with their surroundings in public places. Additionally,building the kiosk 702 to be compatible with the apparatus 700 can makeit easier for a user to carry the apparatus 700 with them and attach theapparatus 700 to any compatible device. Compatibility and connectivitycan be further facilitated by installation of a mobile application(e.g., refer to the mobile application 104 in FIG. 1 ) on the kiosk 702or other device that facilitates such communication between the kiosk702 and the apparatus 700. As a result, in some implementations, ownersof kiosks or other devices in public spaces can merely install theappropriate mobile application (e.g., software) to facilitycommunication and connectivity of the devices with the refreshablebraille display apparatus 700 described herein.

FIG. 8 depicts an exemplary use of the refreshable braille displayapparatus described herein. In this example, the apparatus is asmartphone (e.g., mobile device) case (e.g., refer to the case 200described and depicted in FIG. 2 ). A user is holding the case in theirleft hand. A reading area of the apparatus described herein has acontact surface and a plurality of pins selectively extending from thecontact surface on a right side of the case. As depicted, more than oneof the user's fingertips are in contact with the contact surface of thereading area. As a result, each of the user's fingertips can feel one ormore of the pins selectively extending from the contact surface to formone or more braille character data. The user does not have to move theirfingertips along the contact surface of the reading area in order tofeel/read the pins as they selectively extend from the contract surface.This configuration can make it easier and/or faster for the user to readthe braille character data because the user can maintain theirfingertip(s) in a static position. Each of the braille character datacan be displayed on the reading area at different time intervals, suchthat the user can read each braille character data one at a time as theyare displayed on the reading area (e.g., for increasing braille literacyand/or learning how to read braille). In other implementations, thebraille character data can be displayed simultaneously on the readingarea such that that the reader can read all the braille character dataat the same time (e.g., for faster reading).

In some implementations, the user can position fewer than fourfingertips on the contact surface of the reading area. The user canstill read each of the braille character data as it is displayed becausethe braille character data can be repeated, like a wave, from a bottomportion to a top portion of the reading area or from the top portion tothe bottom portion of the reading area. As a result, wherever one ormore fingertips are positioned on the contact surface of the readingarea, at least one of the fingertips can feel the pins as they areselectively extended from the contact surface.

FIG. 9 depicts an exemplary actuation of the refreshable braille displayapparatus described herein. As depicted, the apparatus includes a firstregion 900, a second region 902, a third region 904, and a fourth region906. Each of the regions 900, 902, 904, and 906 can correspond to one ormore contact units, each having a subset of a plurality of pins (e.g.,refer to FIGS. 2A-C, 3-4). For example, the first region 900 can be afirst contact unit having a first subset of the plurality of pins. Thesecond region 902 can be a second contact unit having a second subset ofthe plurality of pins. The third region 904 can be a third contact unithaving a third subset of the plurality of pins. The fourth region 906can be a fourth contact unit having a fourth subset of the plurality ofpins. As depicted, a user has four fingertips in contact with each ofthe respective regions 900, 902, 904, and 906.

As described throughout this disclosure (e.g., refer to FIG. 11 ), theapparatus can receive text data from a mobile device and can convert thetext data into one or more braille character data. In the example ofFIG. 9 , the text can be converted into at least six characters, a firstcharacter 902, a second character 922, a third character 924, a fourthcharacter 926, a fifth character 928, and a sixth character 930. Inother examples, text data can be converted into any number ofappropriate, corresponding braille character data.

Still referring to FIG. 9 , at a first time 908, the first character 920can be displayed in the first region 900. This can be accomplished bythe controller described herein transmitting an electric current to thefirst region 900 to selectively extend one or more pins within thatregion (e.g., refer to FIGS. 5-6, 11 ). At a second time 910, the firstcharacter 920 can be displayed in the second region 902 and the secondcharacter 922 can be displayed in the first region 900. As a result, theuser can verify the first character 902 by reading it in the secondregion 902 as well as reading the second character 922 for a first time.At a third time 812, the first character 920 can be displayed in thethird region 904, the second character 922 can be displayed in thesecond region 902, and now the third character 924 can be displayed inthe first region 900. Likewise, at a fourth time 914, the firstcharacter 920 can be displayed in the fourth region 906, the secondcharacter 922 can be displayed in the third region 904, the thirdcharacter 924 can be displayed in the second region 902, and now thefourth character 926 can be displayed in the first region 900. At afifth time 916, the first character 920 may no longer be displayed(e.g., alternatively, a reading area having more than four regions(e.g., contact units) can continue displaying characters), the secondcharacter 922 can be displayed in the fourth region 906, the thirdcharacter 8924 can be displayed in the third region 904, the fourthcharacter 926 can be displayed in the second region 902, and now thefifth character 928 can be displayed in the first region 900. Finally,in this example at a sixth time 918, the first character 920 and thesecond character 922 may no longer be displayed (e.g., alternatively, areading area having more than four regions (e.g., contact units) cancontinue displaying characters), the third character 924 can bedisplayed in the fourth region 906, the fourth character 926 can bedisplayed in the third region 904, the fifth character 928 can bedisplayed in the second region 902, and now the sixth character 930 canbe displayed in the first region 900.

The configuration depicted in FIG. 9 permits the user to read all thecharacters 900, 922, 924, 926, 928, and 930 together (e.g., at the times910, 912, 914, 916, 918, etc.). In some implementations, the characters900, 922, 924, 926, 928, and 930 can be repeated after the sixth time918, such that the user can confirm the characters that the user read.This configuration can be advantageous for the user to learn how to readbraille and/or to improve their braille literacy. In someimplementations, the user can adjust an interval between the times 910,912, 914, 916, 918, etc. (e.g., how much time passes between each of thetimes 910, 912, 914, 916, 918, etc.) in order to facilitate for slowerand/or faster reading of braille characters. The user can make suchadjustments via the mobile application described throughout thisdisclosure (e.g., refer to FIG. 1 ).

FIG. 10 depicts an exemplary actuation of the refreshable brailledisplay apparatus described herein. Similar to the example in FIG. 9 ,in FIG. 10 , a user places four fingers on a contact surface of theapparatus, wherein each fingertip is positioned on a respective region(e.g., contact unit): a first region 1000, a second region 1002, a thirdregion 1004, and a fourth region 1006. Each of the regions 1000, 1002,1004, 1006 can correspond to one or more contact units, each having asubset of a plurality of pins (e.g., refer to FIGS. 2A-C, 3-5). Forexample, the first region 1000 can be a first contact unit having afirst subset of the plurality of pins. The second region 1002 can be asecond contact unit having a second subset of the plurality of pins. Thethird region 1004 can be a third contact unit having a third subset ofthe plurality of pins. The fourth region 1006 can be a fourth contactunit having a fourth subset of the plurality of pins.

As described throughout this disclosure (e.g., refer to FIG. 11 ), theapparatus can receive text data from a mobile device and can convert thetext data into one or more braille character data. In the example ofFIG. 10 , the text can be converted into at least eight characters, afirst character 1012, a second character 1014, a third character 1016, afourth character 1018, a fifth character 1020, a sixth character 1022, aseventh character 1024, and an eighth character 1026. In other examples,text data can be converted into any number of appropriate, correspondingbraille character data.

As depicted in FIG. 10 , at a first time 1008, the first character 1012can be displayed in the first region 1000, the second character 1014 canbe displayed in the second region 1002, the third character 1016 can bedisplayed in the third region 1004, and the fourth character 1018 can bedisplayed in the fourth region 1006. In this example, these four braillecharacter data 1012, 1014, 1016, and 1018 are displayed at a same time(e.g., the first time 1008) so that the user can read multiplecharacters at once. This is advantageous for users that are literate inreading braille and/or are legally blind.

In some implementations, if the user's fingertips are not positionedover each of the regions 1000, 1002, 1004, and 1006, but rather arepositioned over one or fewer of the regions, then a number of characterscan be displayed that mirrors a number of regions having fingertipspositioned over them. For example, if the user positions one finger overthe first region 1000 and a second finger over the third region 1004,then at the first time 1008, the first character 1012 can be displayedin the first region 1000 and the second character 1014 cansimultaneously be displayed in the third region 1016. Any remainingcharacters can be displayed in the first region 1000 and the secondregion 1004 in different time intervals. In some implementations, theregions 1000-1006 can include a sensor that detects whether the fingersmake contact with the regions or are proximate to the regions. Thesensor can be of various types, such as a contact sensor, a proximitysensor, a touch sensor, or any other suitable devices for detectingfinger contact or presence proximate to the regions.

Referring back to FIG. 10 , at a second time 1010, the fifth character1020 can be displayed at the first region 1000, the sixth character 1022can be displayed at the second region 1002, the seventh character 1024can be displayed at the third region 1004, and the eighth character 1026can be displayed at the fourth region 1006. As mentioned, the user canadjust how much time passes between each of the times 1008, 1010, etc.in order to facilitate for slower and/or faster reading of braillecharacters. The user can make such adjustments via the mobileapplication described throughout this disclosure (e.g., refer to FIG. 1).

In some implementations, each converted braille character (e.g.,characters 1012, 1014, 1016, 1018) can be displayed at the first time1008 in the corresponding regions 1000, 1002, 1004, and 1006. Then, atthe second time 1010, the same braille characters can be repeated ineach of the corresponding regions. This configuration can beadvantageous so that the user can read a string of braille characters ata single time and then confirm or verify the string of braillecharacters at a second, delayed time before reading a new string ofbraille characters. In the example depicted in FIG. 10 , if the stringof characters ended at the eighth character 1026, then at a third time,the characters 1012, 1014, 1016, and 1018 can be repeated in thecorresponding regions 1000, 1002, 1004, and 1006 and then at a fourthtime, the characters 1020, 1022, 1024, and 1026 can be repeated in thecorresponding regions 1000, 1002, 1004, and 1006.

In some implementations, the user can adjust how many times braillecharacters are repeated across the regions 1000, 1002, 1004, and 1006.In other implementations, as previously discussed in reference to FIG. 9, the user can adjust an amount of time that passes between the firsttime 1008, the second time 1010, etc. In yet other implementations, theuser can select one or more of the regions 1000, 1002, 1004, and 1006for display of the braille characters. For example, the user maydetermine that their fingertips are only in contact with the firstregion 1000 and the second region 1002. As a result, the user can selectfor braille characters to only be displayed at the first region 1000 andthe second region 1002. This can be advantageous to reduce a frequencyand cost of servicing one or more components of the refreshable brailledisplay apparatus because not all of the components (e.g., the thirdsubset of pins in the third region 1004 and the fourth subset of pins inthe fourth region 1006) may be used often. In this example, the firstsubset of pins in the first region 1000 and the second subset of pins inthe second region 1002 can require occasional maintenance while thethird subset of pins in the third region 1004 and the fourth subset ofpins in the fourth region 1006 may not require maintenance until theyare actually used. Any of the adjustments/determinations made by theuser can be made at the mobile application described throughout thisdisclosure (e.g., refer to FIG. 1 ).

The configurations depicted in FIGS. 9 and 10 are advantageous becausethey allow the user to read braille without moving their fingertips overa reading area. The user can read the braille by statically placing oneor more of their fingertips over the reading area (e.g., regions 900,902, 904, 906, 1000, 1002, 1004, 1006). The user's other hand can stillinteract with a display of the user's mobile device. As a result, theuser can cut down on an amount of time and effort required to read thebraille and interact with the mobile device.

FIG. 11 is a flowchart of process 1100 to use the refreshable brailledisplay apparatus 100 described herein. The process 1100 starts when themicrocontroller of the apparatus 100 receives text data from a computingdevice in step 1102. As described herein, the computing device can be asmartphone or other mobile device such as a tablet, laptop, computer,kiosk, or other device having a touch screen display. Themicrocontroller can convert the text data to braille character data instep 1104. The microcontroller can use a dictionary (e.g., refer to thedictionary database 136 in FIG. 1 ) in order to convert the text datainto braille character data. Next, based on the braille character data,the microcontroller can identify a first subset of pins that representsone or more braille characters in step 1106. The first subset of pinscan be in a first contact unit. In some implementations, themicrocontroller can identify a first subset of a plurality of solenoidsthat receive the first subset of pins, wherein the first subset of pinsrepresents one or more braille characters corresponding to the textdata. Based on step 1106, in step 1108, the microcontroller can transmita first electric current to the first subset of the plurality ofsolenoids such that the first subset of pins moves to extend from acontact surface of the refreshable braille display apparatus describedherein. Step 1108 can be performed at a first time.

In step 1110, the microcontroller can identify a second subset of pinsthat represents the one or more braille characters. The second subset ofpins can be in a second contact unit. In some implementations, themicrocontroller can identify a second subset of a plurality of solenoidsthat receive the second subset of pins, wherein the second subset ofpins represents one or more of the braille characters corresponding tothe text data. In step 1112, the microcontroller can transmit the firstelectric current to the second subset of the plurality of solenoids toextend the second subset of pins from the contact surface of theapparatus described herein (e.g., refer to FIG. 9 ). Step 1112 can beperformed at a second time. The second time can be later than the firsttime.

Once the pins are extended from the contact surface, the microcontrollercan determine whether there is more braille character data to bedisplayed in step 1114. If there is, then the microcontroller can returnto step 1106 and repeat the steps described herein. If there is no morebraille character data to display in step 1114, then the microcontrollercan determine whether there is more text data in step 1116. If there isnot, then the process 1100 ends. If there is more text data, then themicrocontroller returns to step 1102 and repeats the steps describedherein. For example, in some implementations, the microcontroller canreceive second text data from the computing device and convert thesecond text data into second braille character data. Based on the secondbraille character data, the microcontroller can identify a third subsetof pins or a third subset of the plurality of solenoids that receivesthe third subset of pins. The third subset of pins can be in a firstcontact unit. In other implementations, the third subset of pins can bein any contact unit (e.g., a second, third, fourth contact unit). Thethird subset of pins can represent a second braille character thatcorresponds to the second text data received from the computing device.Finally, the microcontroller can be configured to transmit the firstelectric current to the third subset of the plurality of solenoids suchthat the third subset of pins moves to extend from the contact surfaceof the refreshable braille display apparatus described herein. The firstelectric current can be transmitted at a third time.

Still referring to FIG. 11 , in some implementations, the third time canbe identical to the second time. The third time can be later than thesecond time. Additionally, the second time can be identical to the firsttime. The second time can be later than the first time. In yet otherimplementations, the third time can be earlier than the second time andlater than the first time.

FIG. 12 is a process 1200 to assemble the refreshable braille displayapparatus described herein. First, a user can attach a plurality ofcontact units to a contact surface of a first base in step 1202. Each ofthe contact units can have a base that couples to a side of the firstbase. The contact units can be positioned side-by-side along the contactsurface of the first base so that the contact units are aligned witheach other. In step 1204, a plurality of braille pins can be positionedwithin a plurality of cavities located within each contact unit. Forexample, if the contact unit has six cavities, six pins can bepositioned within the cavities. In step 1206, solenoids can be at leastpartially wrapped around each of the pins. A magnet can be disposed in ahousing in the first base that is opposite the contact surface in step1208. Next, a second base can be connected to the first base using oneor more conductive wires that are configured to the first base (step1210). A controller can be housed in the second base in step 1212. Then,in step 1214, the first base can be attached to a computing devicehaving a display. As described throughout this disclosure, therefreshable braille display apparatus described herein can be a case fora smartphone or other mobile or computing device. Therefore, in step1214, the first base (e.g., the case) can be attached (e.g., snapped)around the smartphone. In step 1216, the user can configure wirelesscommunication (e.g., connection) with the computing device. Thecommunication can be established using a mobile application andBLUETOOTH technology, as described throughout this disclosure (e.g.,refer to FIG. 1 ). Finally, in step 1218, the contact surface of thefirst base can receive at least one fingertip.

FIG. 13 depicts an exemplary refreshable braille display mouse 1300. Themouse 1300 can include a scroll wheel 1302, a left click button 1304, aright click button 1306, a cable 1308 (e.g., USB) for connecting themouse 1300 to a computer system or device, and a reading area 1310. Thereading area can include a plurality of braille pins 1312A-N, asdepicted and described throughout this disclosure. In otherimplementations, the mouse 1300 can include more or less buttons,wheels, or other types of input elements than those described in FIG. 13. Further, where the mouse 1300 is configured to be wireless, the mouse1300 can include a wireless transmitter/receiver instead of the cable1308.

The mouse 1300 can allow for blind users to navigate a graphical userinterface (GUI) display of a computer or laptop while simultaneouslyreading content that is displayed via the reading area 1310. The readingarea 1310 includes modular refreshable braille pins 1312A-N as describedherein. A user can place fingertips, such as four fingertips, on top ofthe reading area 1310 and read the content displayed on the computer inBraille, as the pins 1312A-N automatically move from right to left tosimulate a Braille reading process.

Placement of the scroll wheel 1302, the left click button 1304, and theright click button 1306 on a left side 1314 of the mouse 1300 isadvantageous for right-handed users to use their thumb to maneuver thecomputer display while simultaneously reading Braille in the readingarea 1310. The mouse 1300 can also be designed and configured to be usedby left-handed users. In other words, a left-handed mouse can includethe scroll wheel 1302, the left click button 1304, and the right clickbutton 1306 on a right side of the mouse.

As an example use, if the user moves the mouse 1300 and a cursor pointsat a “Desktop” folder on the computer display, the characters ‘D’ ‘E’can be read by the user at the reading area 1310 as the braille pins1312A-N automatically move from right to left (or left to right asdesired) to spell out Desktop. The user can feel these characters movingthrough the pinky finger to the index finger as they are positioned overthe reading area 1310. As a result, the user can correctly discern thatthe cursor is pointing to the Desktop folder. The user can then doublepress on the left click button 1304 using their thumb to open the folderor single press the right click button 1306 with the same thumb toaccess the folder options. The scroll wheel 1302 can also be used by thethumb to move through contents in the Desktop folder. The mouse 1300 canallow blind users to efficiently navigate computer screens using onlyone hand, while also allowing them to benefit from literacy skills thatBraille provides in the reading area 1310. As a result, the users maynot have to rely on screen readers on their computers to read andnavigate the computer screens. Moreover, the users may not be requiredto connect external Braille display systems to their computers thatrequire moving back and forth to read content in Braille.

FIG. 14 depicts an exemplary refreshable braille display smartphonemount case 1400. In some implementations, the mount case 1400 has amodular design such that it can be used with any size smartphone.Alternatively, the mount case 1400 can be customized to fit a particularsmartphone model. The mount case 1400 can therefore be dynamicallyadjusted to accommodate size of different smartphones. The mount case1400 includes a base 1401, a camera opening 1402, first and second sides1408A and 1408B, a base support 1410, and adjustable side mounts 1412Aand 1412B. A smartphone can be placed against the base 1401 such thatthe smartphone's camera aligns with the camera opening 1402. The cameraopening 1402 can slide vertically up and down to dynamically adjust fordifferent length smartphones that may be used with the mount case 1400.

Each of the sides 1408A and 1408B of the mount case 1400 can includerespective reading areas 1416. The reading area 1416 includes modularrefreshable braille pins 1414A-N, as described herein. A user can placefingertips, such as four fingertips, on top of the reading area 1416 andread content displayed on the user's smartphone in Braille, as the pins1414A-N automatically move from right to left to simulate a Braillereading process, as described throughout this disclosure. In someimplementations, the braille pins 1414A-N can be on one of the sides1408A and 1408B of the mount case 1400. For example, a mount case 1400intended for left handed users can include the reading area 1416 havingthe braille pins 1414A-N on the right side 1408B. A mount case 1400intended for right handed users can include the reading area 1416 havingthe braille pins 1414A-N on the left side 1408A.

The base support 1410 can include a charging port opening 1404 andmicrophone and/or speaker openings 1406A-N. The charging port opening1404 can be sized such that any smartphone's charging port can beaccessed via the opening 1404. In some implementations, one or morevariations of the mount case 1400 can be made having different sizedcharging port openings 1404 to accommodate for different types ofsmartphones. The openings 1406A-N can be a same size as microphonesand/or speakers of a smartphone. As an example, if a smartphone has 5speakers on each side of the smartphone's charging port, then the mountcase 1400 can have 5 openings 1406A-N on each side of the charging portopening 1404. In some implementations, a singular opening 1406A canextend along a length on one side of the charging port opening 1404 anda second opening 1406B can extend along a length on a second side of thecharging port opening 1404. The first and second openings 1406A and1406B can be opposite each other. As a result of such a configuration,the mount case 1400 can accommodate for placement, arrangement, and/orquantity of microphones and/or speakers along a bottom portion ofdifferent types of smartphones.

The base support 1410 can also include a protruding edge 1411 thatextends along a length of the base support 1410. The protruding edge1411 can extend upwards from the base station 1400 and be configured toengage a portion of a front face of a smartphone received at the mountcase 1400, thereby retaining the bottom portion of the smartphone at thebase support 1410 and restricting the smartphone from sliding out of themount case 1400. In some implementations, the protruding edge 1411 cancup corners (curved corners) that correspond to the bottom corners ofthe smartphone and are configured to cover the bottom corners of thesmartphone to thereby retain the smartphone in the mount case 1400.

The adjustable side mounts 1412A and 1412B can extend out from therespective first and second sides 1408A and 1408B of the mount case1400. Each of the adjustable side mounts 1412A and 1412B can includerespective protruding edges 1413A and 1413B that can be configured toretain the smartphone in the mount case 1400. The protruding edges 1413Aand 1413B can hold partially around edges of each side of thesmartphone. The edges 1413A and 1413B may not extend over a screenportion of the smartphone. The adjustable side mounts 1412A and 1412Bcan be expanded outwards, and retracted inwards, to accommodatesmartphones of different widths. For example, when the user places thesmartphone on top of the base 1401, the user can extend the adjustableside mounts 1412A and 1412B out to sides of the smartphone such that thesmartphone is flush with the base 1401 and the protruding edges 1413Aand 1413B clamp over side edges of the smartphone. The adjustable sidemounts 1412A and 1412B can retract to a sizing that retains thesmartphone in place in the mount case 1400.

The mount case 1400 depicted in FIG. 14 can be advantageous for users touse any type of smartphone with the refreshable braille displaytechnology described throughout this disclosure. As described herein,the mount case 1400 allows the user to read Braille without having tomove their fingertips across the reading area 1416. In someimplementations, the adjustable side mounts 1412A and 1412B can be madeof a plastic material. In some implementations, at least one of the base1401, the first and second sides 1408A and 1408B, the base support 1410,and the reading area 1416 can be encased in aluminum. In someimplementations, the base support 1410 can be made of a plasticmaterial. In yet some implementations, one or more of the base 1401, thefirst and second sides 1408A and 1408B, the base support 1410, and thereading area 1416 can be coated with a plastic and/or silicone gelmaterial with varying degrees of texture. The plastic and/or siliconegel coating can be advantageous to align with the user's handling oftheir device as well as aesthetic appeal of the mount case 1400.

FIG. 15 depicts an exemplary refreshable braille display wearable device1500. The wearable device 1500 can be a bracelet, smart watch, and/orother device that can be worn around a user's wrist or arm. The wearabledevice 1500 can be adjusted to fit on any size wrist or arm of a user.Similar to the other devices and cases described throughout thisdisclosure, the wearable device 1500 can include a reading area 1502with a plurality of braille pins 1504A-N. The braille pins 1504A-N canfunction as described throughout this disclosure. The wearable device1500 can also include a wireless charger 1506. The user can, forexample, place any portion of the wearable device 1500 on top of thewireless charger 1506 to begin charging. Accordingly, components of therefreshable braille display system as described herein can be chargedsuch that the braille pins 1504A-N can automatically move to allow theuser to read content displayed on their mobile device.

The user can place their fingertips over the reading area 1502 in orderto read braille. The wearable device 1500 can also include clockfunctionalities so that the user can check the time. Moreover, thewearable device 1500 can connect to the user's smartphone via wirelessconnection (e.g., WIFI, BLUETOOTH). Notifications, calls, and healthmonitoring of the smartphone can be translated into braille andpresented at the reading area 1502, as described throughout thisdisclosure. In some implementations, the smartwatch 1500 can be made ofan aluminum or similar material. Such material can provide durability.In some implementations, straps 1508A and 1508B can be made of siliconegel material or similar flexible material. Such material can provide foraesthetic appearance and comfortability. The straps 1508A and 1508B canalso have a colorful finishing for customization and aesthetic appeal.

Any one or more of the devices and cases described herein (e.g., case200, case 400, first and second bases 500 and 520, apparatus 700, mouse1300, mount case 1400, wearable device 1500, etc.) can be enclosed inaluminum or similar material. The aluminum can provide durability andrigidness for one or more components of the refreshable braille displaysystem describe herein, such as solenoid actuators. Outer materials ofsuch devices and cases can also be coated with plastic and/or siliconegel materials. The plastic and/or silicone gel materials can havevarying degrees of texture (e.g., smooth, ribbed, etc.) to align withthe user's handling of their device. The varying degrees of texture andplastic and/or silicone gel materials can also provide aesthetic appeal.

FIG. 16 is a block diagram of computing devices 1600, 1650 that may beused to implement the systems and methods described in this document, aseither a client or as a server or plurality of servers. Computing device1600 is intended to represent various forms of digital computers, suchas laptops, desktops, workstations, personal digital assistants,servers, blade servers, mainframes, and other appropriate computers.Computing device 1650 is intended to represent various forms of mobiledevices, such as personal digital assistants, cellular telephones,smartphones, and other similar computing devices. Additionally computingdevice 1600 or 1650 can include Universal Serial Bus (USB) flash drives.The USB flash drives may store operating systems and other applications.The USB flash drives can include input/output components, such as awireless transmitter or USB connector that may be inserted into a USBport of another computing device. The components shown here, theirconnections and relationships, and their functions, are meant to beexemplary only, and are not meant to limit implementations of theinventions described and/or claimed in this document.

Computing device 1600 includes a processor 1602, memory 1604, a storagedevice 1606, a high speed interface 1608 connecting to memory 1604 andhigh speed expansion ports 1610, and a low speed interface 1612connecting to low speed bus 1614 and storage device 1606. Each of thecomponents 1602, 1604, 1606, 1608, 1610, and 1612, are interconnectedusing various busses, and may be mounted on a common motherboard or inother manners as appropriate. The processor 1602 can processinstructions for execution within the computing device 1600, includinginstructions stored in the memory 1604 or on the storage device 1606 todisplay graphical information for a GUI on an external input/outputdevice, such as display 1616 coupled to high speed interface 1608. Inother implementations, multiple processors and/or multiple buses may beused, as appropriate, along with multiple memories and types of memory.Also, multiple computing devices 1600 may be connected, with each deviceproviding portions of the necessary operations (e.g., as a server bank,a group of blade servers, or a multi-processor system).

The memory 1604 stores information within the computing device 1600. Inone implementation, the memory 1604 is a volatile memory unit or units.In another implementation, the memory 1604 is a non-volatile memory unitor units. The memory 1604 may also be another form of computer-readablemedium, such as a magnetic or optical disk.

The storage device 1606 is capable of providing mass storage for thecomputing device 1600. In one implementation, the storage device 1606may be or contain a computer-readable medium, such as a floppy diskdevice, a hard disk device, an optical disk device, or a tape device, aflash memory or other similar solid state memory device, or an array ofdevices, including devices in a storage area network or otherconfigurations. A computer program product can be tangibly embodied inan information carrier. The computer program product may also containinstructions that, when executed, perform one or more methods, such asthose described above. The information carrier is a computer- ormachine-readable medium, such as the memory 1604, the storage device1606, or memory on processor 1602.

The high speed controller 1608 manages bandwidth-intensive operationsfor the computing device 1600, while the low speed controller 1612manages lower bandwidth-intensive operations. Such allocation offunctions is exemplary only. In one implementation, the high speedcontroller 1608 is coupled to memory 1604, display 1616 (e.g., through agraphics processor or accelerator), and to high speed expansion ports1610, which may accept various expansion cards (not shown). In theimplementation, low speed controller 1612 is coupled to storage device1606 and low speed expansion port 1614. The low speed expansion port,which may include various communication ports (e.g., USB, Bluetooth,Ethernet, wireless Ethernet) may be coupled to one or more input/outputdevices, such as a keyboard, a pointing device, a scanner, or anetworking device such as a switch or router, e.g., through a networkadapter.

The computing device 1600 may be implemented in a number of differentforms, as shown in the figure. For example, it may be implemented as astandard server 1620, or multiple times in a group of such servers. Itmay also be implemented as part of a rack server system 1624. Inaddition, it may be implemented in a personal computer such as a laptopcomputer 1622. Alternatively, components from computing device 1600 maybe combined with other components in a mobile device (not shown), suchas device 1650. Each of such devices may contain one or more ofcomputing device 1600, 1650, and an entire system may be made up ofmultiple computing devices 1600, 1650 communicating with each other.

Computing device 1650 includes a processor 1652, memory 1664, aninput/output device such as a display 1654, a communication interface1666, and a transceiver 1668, among other components. The device 1650may also be provided with a storage device, such as a microdrive orother device, to provide additional storage. Each of the components1650, 1652, 1664, 1654, 1666, and 1668, are interconnected using variousbuses, and several of the components may be mounted on a commonmotherboard or in other manners as appropriate.

The processor 1652 can execute instructions within the computing device1650, including instructions stored in the memory 1664. The processormay be implemented as a chipset of chips that include separate andmultiple analog and digital processors. Additionally, the processor maybe implemented using any of a number of architectures. For example, theprocessor 1602 may be a CISC (Complex Instruction Set Computers)processor, a RISC (Reduced Instruction Set Computer) processor, or aMISC (Minimal Instruction Set Computer) processor. The processor mayprovide, for example, for coordination of the other components of thedevice 1650, such as control of user interfaces, applications run bydevice 1650, and wireless communication by device 1650.

Processor 1652 may communicate with a user through control interface1658 and display interface 1656 coupled to a display 1654. The display1654 may be, for example, a TFT (Thin-Film-Transistor Liquid CrystalDisplay) display or an OLED (Organic Light Emitting Diode) display, orother appropriate display technology. The display interface 1656 maycomprise appropriate circuitry for driving the display 1654 to presentgraphical and other information to a user. The control interface 1658may receive commands from a user and convert them for submission to theprocessor 1652. In addition, an external interface 1662 may be providein communication with processor 1652, so as to enable near areacommunication of device 1650 with other devices. External interface 1662may provide, for example, for wired communication in someimplementations, or for wireless communication in other implementations,and multiple interfaces may also be used.

The memory 1664 stores information within the computing device 1650. Thememory 1664 can be implemented as one or more of a computer-readablemedium or media, a volatile memory unit or units, or a non-volatilememory unit or units. Expansion memory 1674 may also be provided andconnected to device 1650 through expansion interface 1672, which mayinclude, for example, a SIMM (Single In Line Memory Module) cardinterface. Such expansion memory 1674 may provide extra storage spacefor device 1650, or may also store applications or other information fordevice 1650. Specifically, expansion memory 1674 may includeinstructions to carry out or supplement the processes described above,and may include secure information also. Thus, for example, expansionmemory 1674 may be provide as a security module for device 1650, and maybe programmed with instructions that permit secure use of device 1650.In addition, secure applications may be provided via the SIMM cards,along with additional information, such as placing identifyinginformation on the SIMM card in a non-hackable manner.

The memory may include, for example, flash memory and/or NVRAM memory,as discussed below. In one implementation, a computer program product istangibly embodied in an information carrier. The computer programproduct contains instructions that, when executed, perform one or moremethods, such as those described above. The information carrier is acomputer- or machine-readable medium, such as the memory 1664, expansionmemory 1674, or memory on processor 1652 that may be received, forexample, over transceiver 1668 or external interface 1662.

Device 1650 may communicate wirelessly through communication interface1666, which may include digital signal processing circuitry wherenecessary. Communication interface 1666 may provide for communicationsunder various modes or protocols, such as GSM voice calls, SMS, EMS, orMMS messaging, CDMA, TDMA, PDC, WCDMA, CDMA2000, or GPRS, among others.Such communication may occur, for example, through radio-frequencytransceiver 1668. In addition, short-range communication may occur, suchas using a Bluetooth, WiFi, or other such transceiver (not shown). Inaddition, GPS (Global Positioning System) receiver module 1670 mayprovide additional navigation- and location-related wireless data todevice 1650, which may be used as appropriate by applications running ondevice 1650.

Device 1650 may also communicate audibly using audio codec 1660, whichmay receive spoken information from a user and convert it to usabledigital information. Audio codec 1660 may likewise generate audiblesound for a user, such as through a speaker, e.g., in a handset ofdevice 1650. Such sound may include sound from voice telephone calls,may include recorded sound (e.g., voice messages, music files, etc.) andmay also include sound generated by applications operating on device1650.

The computing device 1650 may be implemented in a number of differentforms, as shown in the figure. For example, it may be implemented as acellular telephone 1680. It may also be implemented as part of asmartphone 1682, personal digital assistant, or other similar mobiledevice.

Various implementations of the systems and techniques described here canbe realized in digital electronic circuitry, integrated circuitry,specially designed ASICs (application specific integrated circuits),computer hardware, firmware, software, and/or combinations thereof.These various implementations can include implementation in one or morecomputer programs that are executable and/or interpretable on aprogrammable system including at least one programmable processor, whichmay be special or general purpose, coupled to receive data andinstructions from, and to transmit data and instructions to, a storagesystem, at least one input device, and at least one output device.

These computer programs (also known as programs, software, softwareapplications or code) include machine instructions for a programmableprocessor, and can be implemented in a high-level procedural and/orobject-oriented programming language, and/or in assembly/machinelanguage. As used herein, the terms “machine-readable medium”“computer-readable medium” refers to any computer program product,apparatus and/or device (e.g., magnetic discs, optical disks, memory,Programmable Logic Devices (PLDs)) used to provide machine instructionsand/or data to a programmable processor, including a machine-readablemedium that receives machine instructions as a machine-readable signal.The term “machine-readable signal” refers to any signal used to providemachine instructions and/or data to a programmable processor.

To provide for interaction with a user, the systems and techniquesdescribed here can be implemented on a computer having a display device(e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor)for displaying information to the user and a keyboard and a pointingdevice (e.g., a mouse or a trackball) by which the user can provideinput to the computer. Other kinds of devices can be used to provide forinteraction with a user as well; for example, feedback provided to theuser can be any form of sensory feedback (e.g., visual feedback,auditory feedback, or tactile feedback); and input from the user can bereceived in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in acomputing system that includes a back end component (e.g., as a dataserver), or that includes a middleware component (e.g., an applicationserver), or that includes a front end component (e.g., a client computerhaving a graphical user interface or a Web browser through which a usercan interact with an implementation of the systems and techniquesdescribed here), or any combination of such back end, middleware, orfront end components. The components of the system can be interconnectedby any form or medium of digital data communication (e.g., acommunication network). Examples of communication networks include alocal area network (“LAN”), a wide area network (“WAN”), peer-to-peernetworks (having ad-hoc or static members), grid computinginfrastructures, and the Internet.

The computing system can include clients and servers. A client andserver are generally remote from each other and typically interactthrough a communication network. The relationship of client and serverarises by virtue of computer programs running on the respectivecomputers and having a client-server relationship to each other.

Particular implementations of the subject matter have been described.Other implementations are within the scope of the following claims. Insome cases, the actions recited in the claims can be performed in adifferent order and still achieve desirable results. In addition, theprocesses depicted in the accompanying figures do not necessarilyrequire the particular order shown, or sequential order, to achievedesirable results. In certain implementations, multitasking and parallelprocessing may be advantageous.

What is claimed is:
 1. An apparatus for refreshable braille display, theapparatus comprising: a first base including a contact surface and aplurality of cavities, the contact surface configured to receivefingertips, the plurality of cavities being recessed from the contactsurface; a plurality of pins housed within the plurality of cavities andconfigured to move in the plurality of cavities to selectively extendfrom the contact surface of the first base; a plurality of solenoidsconfigured to at least partially operably connect to the plurality ofpins; and a controller configured to selectively provide a firstelectric current to the plurality of solenoids to generate firstmagnetic fields through the plurality of solenoids, wherein the firstmagnetic fields are configured to selectively move the plurality of pinsto extend from the contact surface of the first base, wherein one ormore of the cavities are removable from the first base.
 2. The apparatusof claim 1, further comprising a magnet disposed in the first base,wherein the magnet is configured to generate an attractive forcerelative to the plurality of pins such that the plurality of pins arebiased into the cavities, and wherein the first magnetic fields createrepulsion forces between the plurality of pins and the magnet, therepulsion forces configured to cause the plurality of pins to extendfrom the contact surface of the first base.
 3. The apparatus of claim 1,wherein the controller is configured to selectively provide a secondelectric current to the plurality of solenoids to generate secondmagnetic fields through the plurality of solenoids, the second magneticfields configured to selectively move the plurality of pins into thecavities.
 4. The apparatus of claim 1, wherein the plurality ofsolenoids include coils wrapped around the pins.
 5. The apparatus ofclaim 1, further comprising: a second base configured to house thecontroller and attach to the first base; and one or more connectorsextending from the first base and configured to engage with the secondbase to attach the first base to the second base, wherein the one ormore connectors include conductive wires configured to externallyconnect the controller to the plurality of solenoids.
 6. The apparatusof claim 1, wherein the contact surface of the first base includes aplurality of contact units, each contact unit including one or more ofthe plurality of cavities and configured to permit for a fingertip tocontact, and wherein the contact surface of the first base is configuredto permit for multiple fingertips to simultaneously contact theplurality of contact units, respectively.
 7. The apparatus of claim 1,wherein the first base is configured to attach to a device having adisplay and wherein the first base is configured to communicate with thedevice, the device being at least one of a computer, a smartphone, or akiosk.
 8. The apparatus of claim 1, wherein the first base is integratedinto a wearable device to be worn around a wrist of a user.
 9. Theapparatus of claim 1, wherein the first base is integrated into rightand left sides of a smartphone case, wherein the smartphone caseincludes adjustable side mounts that extend out from the right and leftsides of the smartphone case, the adjustable side mounts configured toexpand to a width of a smartphone and to retain the smartphone in thesmartphone case.
 10. The apparatus of claim 1, wherein the controller isfurther configured to: receive text data from a computing device;convert the text data into braille character data; based on the braillecharacter data, identify a subset of the plurality of pins or a subsetof the plurality of solenoids that receives the subset of the pluralityof pins, wherein the subset of the plurality of pins represents one ormore braille characters corresponding to the text data; and transmit thefirst electric current to the subset of the plurality of solenoids suchthat the subset of the plurality of pins moves to extend from thecontact surface of the first base.
 11. The apparatus of claim 6, whereinthe plurality of contact units includes a first contact unit and asecond contact unit, and wherein the controller is configured to:receive first text data from a computing device; convert the first textdata into first braille character data; based on the first braillecharacter data, identify a first subset of the plurality of pins in thefirst contact unit, or a first subset of the plurality of solenoids thatreceives the first subset of the plurality of pins in the first contactunit, wherein the first subset of the plurality of pins represents afirst braille character corresponding to the first text data; andtransmit the first electric current to the first subset of the pluralityof solenoids such that, at a first time, the first subset of theplurality of pins moves to extend from the first contact unit of thefirst base.
 12. The apparatus of claim 11, wherein the controller isconfigured to: based on the first braille character data, identify asecond subset of the plurality of pins in the second contact unit, or asecond subset of the plurality of solenoids that receives the secondsubset of the plurality of pins in the second contact unit, wherein thesecond subset of the plurality of pins represents the first braillecharacter corresponding to the first text data; and transmit the firstelectric current to the second subset of the plurality of solenoids suchthat, at a second time later than the first time, the second subset ofthe plurality of pins moves to extend from the first contact unit of thefirst base, wherein the second subset of the plurality of pins in thesecond contact unit is positioned identically to the first subset of theplurality of pins in the first contact unit.
 13. The apparatus of claim12, wherein the controller is configured to: receive second text datafrom the computing device; convert the second text data into secondbraille character data; based on the second braille character data,identify a third subset of the plurality of pins in the first contactunit, or a third subset of the plurality of solenoids that receives thethird subset of the plurality of pins in the first contact unit, whereinthe third subset of the plurality of pins represents a second braillecharacter corresponding to the second text data; and transmit the firstelectric current to the third subset of the plurality of solenoids suchthat, at a third time, the third subset of the plurality of pins movesto extend from the first contact unit of the first base.
 14. Theapparatus of claim 13, wherein the third time is (i) identical to thesecond time, (ii) later than the second time, or (iii) earlier than thesecond time and later than the first time.
 15. The apparatus of claim13, wherein the controller is configured to: receive second text datafrom the computing device; convert the second text data into secondbraille character data; based on the second braille character data,identify a fourth subset of the plurality of pins in the second contactunit, or a fourth subset of the plurality of solenoids that receives thefourth subset of the plurality of pins in the first contact unit,wherein the fourth subset of the plurality of pins represents a secondbraille character corresponding to the second text data; and transmitthe first electric current to the fourth subset of the plurality ofsolenoids such that, at the first time, the fourth subset of theplurality of pins moves to extend from the second contact unit of thefirst base.
 16. An apparatus for refreshable braille display, theapparatus comprising: a first base including a contact surface and aplurality of cavities, the contact surface configured to receivefingertips, the plurality of cavities being recessed from the contactsurface; a plurality of contact units attached to the contact surfaceand arranged side by side, wherein each contact unit includes at leastsix of the plurality of cavities, and wherein each of the plurality ofcontact units are configured to be removable from the contact surface ofthe first base; a plurality of pins housed within the plurality ofcavities and configured to move in the plurality of cavities toselectively extend from the contact surface of the first base; aplurality of solenoids configured to at least partially operably connectto the plurality of pins; and a controller configured to selectivelyprovide a first electric current to the plurality of solenoids togenerate first magnetic fields through the plurality of solenoids,wherein the first magnetic fields are configured to selectively move theplurality of pins to extend from the contact surface of the first base,wherein one or more of the plurality of cavities are removable from thefirst base.
 17. The apparatus of claim 16, wherein the plurality ofcontact units includes a first contact unit and a second contact unit.18. The apparatus of claim 17, wherein the controller is configured to:receive first text data from a computing device; convert the first textdata into first braille character data; based on the first braillecharacter data, identify a first subset of the plurality of pins in thefirst contact unit, or a first subset of the plurality of solenoids thatreceives the first subset of the plurality of pins in the first contactunit, wherein the first subset of the plurality of pins represents afirst braille character corresponding to the first text data; andtransmit the first electric current to the first subset of the pluralityof solenoids such that, at a first time, the first subset of theplurality of pins moves to extend from the first contact unit of thefirst base.
 19. The apparatus of claim 18, wherein the controller isconfigured to: based on the first braille character data, identify asecond subset of the plurality of pins in the second contact unit, or asecond subset of the plurality of solenoids that receives the secondsubset of the plurality of pins in the second contact unit, wherein thesecond subset of the plurality of pins represents the first braillecharacter corresponding to the first text data; and transmit the firstelectric current to the second subset of the plurality of solenoids suchthat, at a second time later than the first time, the second subset ofthe plurality of pins moves to extend from the first contact unit of thefirst base.